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a ^ TRANSIT DELAY AND JITTER CALCULATIONS IN A NETWORK 

nrt A. 

iVi 

Field Qf thg Invention 

The invention relates to networking technology 
5 and more specifically, to methods for determining 

network performance. 

Background to t he Invention 

A communications network is increasingly 
1 10 becoming the foundation upon which many applications and 

]% services are built* The classic example of such a 

sfj popular communications network is the Internet upon 

which, among other things, a whole new field of business 
ip termed e-commerce is based. Even within a local 

: ^ 15 environment, a communications network is used for 

Q applications such as electronic mail for the 

!«; dissemination of information within an organization, 

ijj The quality of applications and services running over 

]z. these networks is dependent on the quality of service 

20 provided by the underlying networks. This creates a 

need for automatic methods of measuring a network' s 
quality. One such measure of the quality of a network 
is the delay in communication between a pair of devices 
in the network. Another measure is jitter - this 
25 measures the variance of this delay. Depending on the 

application, either delay measurements or jitter 
measurements or both may be of interest. For example, 
in Voice over IP (Internet Protocol) applications, not 
only is delay important but jitter as well - two users 
30 communicating by voice over the network should not 

experience a lag in communication, nor should they 
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experience abrupt pauses in their conversation. Methods 
which perform these measurements can be used by a 
network administrator who is interested in evaluating or 
monitoring a network to ensure it meets the criteria for 
5 the deployment of an application over the network . 

Ideally, such measurements are made remotely 
or from a specific fixed node in the network. This 
avoids the need for each node in the network to measure 
its own performance- Such individual piecemeal 

10 measurements would contribute to a degradation of 

network performance and potentially adversely affect the 
measurement results. 

One tool which can be of use in performing 
such measurements is the topology of the network. 

15 Methods of determining the topology of a network are 

known in the art such as that described by Dawes et al 
in US Patent 5,933,416 and US Patent 5,926,462. 

Accordingly, there is a need for methods which 
can be used to automatically measure network 

20 performance. Ideally, such methods would take advantage 

of the knowledge of the topology of the network. 

gymm^ry of the Invention 

The present invention includes methods which 

25 determines network performance by determining not only 

the transit delay between nodes in a network but also 
the variance, or jitter, of such transit delays. A 
common node, usually a network management computer 
(NMC) , sends out a signal to a first node of interest 

30 and measures the time before it receives an 

acknowledgment from the first node. The NMC then sends 
out a similar signal to a second node of interest and 
similarly measures the time required to receive an 
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acknowledgment. Based on these two measurements, the 
transit delay between the first and second nodes can be 
calculated if the first node lies on the path between 
the NMC and the second node or vice versa. For a 
5 multiple node communications path, the total transit 

delay between any two nodes is the sum total of the 
transit delays between adjacent nodes lying on the path. 
In the case of meshed networks, where a path to a node 
may be ambiguous, additional measurement nodes 
10 strategically positioned in the network can be used such 

a way that the transit delay between any adjacent pair 

□ of nodes can be calculated unambiguously from at least 

3 one of these measurement nodes, i.e., the portion of the 

Jj s 

H network being measured will be reduced to a hierarchical 

y 15 one with respect to at least one of the measurement 

fi nodes. 

^ In a first embodiment, the invention provides 

□ a method of determining a transit delay between a first 
fj node and a second node in a hierarchical segment of a 

H 20 network connected to both the first node and the second 

node, the method comprising: 

a) sending a first signal from a common node 
to the first node; 

b) receiving a first response signal at the 

25 common node from the first node in response to the first 

signal; 

c) determining a first round trip time, the 
first round trip time being the time elapsed between 
steps a) and b) ; 

30 d) sending a second signal from the common 

node to the second node; 
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e) receiving a second response signal at the 
common node from the second node in response to the 
second signal; 

f) determining a second round trip time, the 
5 second round trip time being the time elapsed steps d) 

and e) ; and 

g) calculating the transit delay between the 
first node and the second node according to the formula 

D(X,Y)= | R (NMC, X) -R (NMC, Y) |/2 

10 where 

D(X,Y) is the transit delay between first node 

2 X and second node Y; 

« R(NMC,X) is the first round trip time; 

q R (NMC, Y) is the second round trip time; and 

y 15 NMC is the common node. 

u 

jj In a second embodiment, the invention provides 

^ a method of determining a total transit delay between a 

3 start node and an end node in a network the method 
il comprising: 

ij 20 a) determining interim transit delays between 

!? adjacent nodes in a communications path between the 

start node and the end node; and 

b) calculating the total transit delay between 
the start node and the end node by adding up the interim 
25 transit delays. In the case where multiple paths may 

exist between the start node and the end node, separate 
total transit delays will be associated with each 
possible path. 

In a third embodiment, the invention provides 
30 a method of determining the quality of communications 

between two nodes in a network, the method comprising: 
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a) measuring a transit delay between the two 
nodes at different times resulting in a plurality of 
transit delay measurements; 

b) calculating the jitter among the plurality 
5 of time delay measurements; and 

c) determining if the jitter exceeds a 
predetermined threshold value. 

In a fourth embodiment, a method of 
determining a jitter between two transit delay 
10 measurements between two nodes, the method comprising: 

calculating the jitter based on 
J(A,D,t) = D(A,D,t 2 ) - D(A,D,t 1 )) 

where 

J(A,D,t) is the jitter between the two transit 
15 delay measurements; 

D (A, D, t a ) is one of the two transit delay 
measurements taken at time t x ; 

D(A, D,t 2 ) is the other of the two transit 
delay measurements taken at time t 2 ; and 
20 A and D are the two nodes between which the 

transit delay is measured. 

In a fifth embodiment the invention provides a 
method of determining a total jitter between a start 
node and an end node in a network, the method 
25 comprising: 

a) determining interim jitters in transit 
delays between adjacent nodes in a communications path 
between the start node and the end node; 

b) calculating the total jitter in transit 

30 delays between the start node and the end node by adding 

up the interim jitters. 

In a sixth embodiment the invention provides a 
method of determining a jitter between a plurality of 
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transit delay measurements between two nodes, the method 
comprising : 

calculating the jitter based on 
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1=1 
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where 

J(A,B) is the jitter between the plurality of 
transit delay measurements; 

D(A, B,i) is the i th transit delay measurement 
among the plurality of transit delay measurements; and 

M is the number of transit delay measurements. 

In a seventh embodiment the invention provides 
a method of determining a signal processing time in a 
node, the method comprising: 

a) determining at least one round trip delay 
time of a transmission between a node A and a node K; 

b) determining a round trip delay time of a 
transmission between a node B and a node K; 

c) determining a lowest recorded value for the 
round trip delay time between node A and node K; 

d) calculating the signal processing time 
through node A according to: 

P(A) = R(K,B) - minimum (R (K, A) ) 

where 

P (A) is the signal processing time through 

node A; 

R(K,B) is a round trip delay time between node 



B and node K; and 

(minimum (R (K, A) ) is the lowest recorded value 
for the round trip delay time between node A and node K. 

5 Brief Description of the Drawings 

A better understanding of the invention may be 
obtained by reading the detailed description of the 
invention below, in conjunction with the following 
drawings, in which: 
10 Figure 1 is a topology of a portion of a 

network showing the connections between different nodes; 
□ and 

% Figure 2 is a topology of a portion of a 

o hierarchical network showing the connections between 

~ 15 different nodes. 

Figure 3 is a topology of a mesh network 
showing the connections between different nodes. 

Description Qf the Preferred Embodiment 
20 Referring to Fig, 1, a sample network 10 

consisting of nodes Kl, Al, Bl, CI is illustrated. In 
executing the following methods, it is preferred that 
the topology of the network be known. US Patents 
5,933,416 and 5,926,462 disclose such methods for 
25 determining a network topology. These methods are well 

suited for practitioners of the current invention. 

To determine the transit delay between two 
nodes, a first node Al and a second node Bl, using a 
common node Kl, which functions as a standard reference 
30 node from which all measurements are taken a number of 

assumptions can be made for simplicity. 
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Let R(K1, Al, t) be the round trip delay from 
the reference point Kl to the node Al measured at time 
t. 

It is assumed that the delays are symmetric, 
5 i.e., that the delay from a device Kl to a node Al is 

the same as the delay from node Al to node Kl . 
Thus, 

D(K1, Al, t) = D(A1, Kl, t) 

where D(K1, Al, t) is the delay between a signal leaving 
10 node Kl directed towards node Al and the same signal 

being received at Al . 

From the above assumption, 
D(K1, Al, t) = R(K1, Al, t) / 2 
Now let there exist a device Bl in the network 
15 such that device Al lies on the path from Kl to Bl. 

This network is illustrated in Fig. 1. 
Thus, 

D(Kl,Bl,t) = D(Kl,Al,t) + D(Al,Bl,t) 
i.e. D(Al,Bl,t) = D(Kl,Bl,t) -D(Kl,Al,t) 

20 - (R(Kl,Bl,t) - R(K1, Al,t)) / 2 

If the path from Al to CI leads through Bl, then 

D(Al,Cl,t) = D(Al,Bl,t) + D(Bl,Cl,t) (1) 

25 

This means that the delay between Al and CI is 
the sum of the interim delays between adjacent nodes on 
the path from Al to CI. Thus, the delay between Al and 
Bl (D(Al,Bl,t) added to the delay between Bl and CI 
30 (D(Bl,Cl,t)) is the total delay between Al and CI. We 

can find the delay between Al and Bl using the above 
formula and we can similarly find the delay between Bl 
and CI using similar techniques. 
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We can therefore find the delay between a pair 
of nodes Al and CI based on measurements taken from a 
common node Kl . 

From the above, the transit delay between any 
5 two nodes in a network can thus be found using 

measurements made from a common node. 

It should be noted that the method outlined 
above is best suited for hierarchical networks. Such a 
hierarchical network is illustrated in Figure 2. In 
10 hierarchical networks, there is only one path from one 

node to another. Thus, as can be seen from Figure 2, in 

□ the network 20, the only path from node A to node D is 
^ through nodes B and C. 

fl However, it should also be noted that the 

% s 15 method above can be adapted for use with mesh networks 

II such as network 30 shown in Figure 3. The network in 

" Figure 3 is not a hierarchical network in that multiple 

□ paths are possible between two nodes. For example, the 
t\ path from node K to node R can be through the nodes K, 
AJ 20 A, Q and R or through the nodes K, A, B, Q, R, or 

% through the nodes K, A, B, C, D and R. 

To determine the delay between nodes K and R, 
we know from the above that this delay is the sum of the 
interim delays between adjacent nodes which are in the 

25 path from node K to R. Thus, once the delays between 

such adjacent nodes are determined, the delay between 
nodes K and R, via a certain path, can easily be found. 
To find such interim delays between adjacent nodes, 
measurements of transit delay can be made from different 

30 common nodes. In Figure 3, any of the nodes can be used 

as a common node from which delay measurements are made. 
Suitable combinations of node pairs can be used to 
determine the transit delay between nodes. Since the 
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topology of the network is known, this would simply be a 
matter of choosing which nodes to combine. Thus, again 
using Figure 3, the delay between nodes A and Q can 
easily be determined as they are adjacent and directly 
5 connected nodes. The same can be said for node pairs Q- 

R, B-Q and D-R. So, to find the delay between nodes K 
and R, using a path which goes through nodes A and Q, 
would be a matter of adding the transit delay between 
nodes K-A, A-Q and Q-R. 

10 It can therefore be seen that any suitable 

sized portion of a network is a hierarchical network. 
While the network of Figure 3 is a mesh network as a 
whole, portions are hierarchical. Two directly 
connected adjacent nodes are the smallest hierarchical 

15 network. Thus, the subnetwork comprising nodes T, S and 

R is a hierarchical subnetwork arm of the mesh network. 
Similarly, subnetwork Q-B is hierarchical along with 
subnetwork X, Y and Z. 

By subdividing a mesh network into smaller 

20 hierarchical subnetworks and moving the common or 

reference node to nodes within such subnetworks, the 
method above is clearly applicable to mesh networks. 
Iterative application of the above method to the 
hierarchical subnetworks eventually results in the 

25 measurement of transit delay between adjacent nodes. 

Ideally, the signal sent from the common node, 
usually a network management computer (NMC) to a node 
being queried is one that does not require extensive 
processing time at the node being queried. This signal 

30 can be a ping or its equivalent which, when sent from a 

device A to device B, should result in a corresponding 
reply signal being sent from device B to device A. The 
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corresponding reply signal need not be similar to the 
original signal received by B. 

In cases where the processing time at a node 
is appreciable, it is assumed that this time is a 
5 constant and is adjusted for in delay calculations 

concerning that node. We outline below one way of 
determining this processing time: 

Consider two adjacent nodes Al and Bl which 
are connected such that the path to Bl from the NMC, Kl, 

10 goes through Al as in Figure 1. Let R(K1, Bl) and R(K1, 

Al) be the round trip delays to nodes Bl and Al from Kl 
respectively. If, at any given time, R(K1, Bl) is less 
than the minimum ever recorded value of R(kl, Al) then 
this discrepancy is attributed to the extra processing 

15 time at node Al and hence we deduce the processing time 

of Al, P(A1) , as 

P(A1) = R(K1,B1) - minimum (R (K1,A1 ) ) 
This processing time is then subtracted from all delay 
calculations involving node Al . For example: 

20 R(K1,A1) = R(K1,A1) - P(A1) 

To determine the variance or jitter in transit 
delay between nodes, multiple determinations of transit 
delay between two nodes need to be made. Once this data 
is collected, variance or jitter can be found. 

25 Even with this assumption, we can still 

generalize jitter calculations. We can compute the 
jitter J (A, C) between nodes A and C over M samples of 
D (A, C, t) . When M = 2, we compute the instantaneous 
jitter J(A, C) as 

30 J(A, C) = D(A,C,t 2 ) - DtAfCta) (2) 

where time t2 > tl. In this case, we preserve the sign 
or direction of change in transit delay. 
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In the case of M samples where M > 2, we 
compute the jitter as the variance over the M samples 
using the formula: 
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As an example, a portion of a network with a 
topology as shown in Fig. 2 can be used. In this 
network, node K is the reference point (or the NMC) and 
we want to compute the delay and the jitter in the 
communications path A - D. 

Let the NMC (node K) send signals to nodes A, 
B, C and D at times t x and t 2 and obtain the following 
round trip values (all in milliseconds) . (Note: It is 
assumed that time t 2 > t a ) 



20 



R(K,A,t) = 

R(K,B,t) = 

R(K,C,t) = 

R(K,D,t) = 



time t a 

9.2 

7.6 

3.4 

4.6 



time t 2 

9.8 

6.8 

3.2 

4.8 



milliseconds 
milliseconds 
milliseconds 
milliseconds 



where, as above, R (A, B,t) is the total time elapsed 
between node A sending a signal to node B at time t and 
node A receiving a corresponding signal from node B 
25 where the corresponding signal is sent by B only after 

the receipt of the original signal from node A. 
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Then the following values can therefore be 
found (again using the notation introduced above and 
from (1) ) : 

5 D(B,A,ti) = (9.2 - 7.6) / 2 = 0.8 ms 

DfC/Bfti) = (7.6 - 3.4) / 2 = 2.1 ms 
D(C,D,t x ) = (4.6 - 3.4) / 2 = 0.5 ms 

Therefore, the delay between node A and D can be found 
10 as: 

D(A / D / t 1 ) = D(B,A,t x ) + D^CtJ + DICD.tj) 
=0.8+2.1+0.5 
= 3.4 ms 

15 For time t 2/ similar calculations can be carried out: 

D(B,A,t 2 ) = (9.8 - 6.8) / 2 = 1.5 ms 
D(C,B,t 2 ) = (6.8 - 3.2) / 2 = 1.8 ms 
D(C,D,t 2 ) = (4.8 - 3.2) / 2 = 0.8 ms 

20 A second total transit delay between nodes A and D is 

therefore : 

D(A,D,t 2 ) = D(B,A,t 2 ) + D(B,C,t 2 ) + D(C,D,t 2 ) 
=1.5+1.8+0.8 
= 4.1 ms 
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We can now estimate jitter in the path A - D as (from 
(2) ) 

J(A,D) = (D(A,D,t 2 ) - D(A,D / t 1 )) 
J(A, D) = 0.7 ms 

The above jitter calculations are based on two 
transit delay measurements. However, long term jitter 
or variance in transit delay between two nodes can 
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easily be found using well known statistical methods. 
Such variance, whether long term or between two 
measurements, can be used as a measure of the quality of 
communications between two nodes. 
5 Because the variance is essentially a measure 

of the extent a transit delay may deviate from the mean 
transit delay, by comparing this variance with a 
predetermined threshold, one can measure how bad the 
delay can be. If the application being used on the 

10 network cannot tolerate a specific maximum transit delay 

or a specific maximum jitter, then the network is not 
suitable for this application. Alternatively, as long 
as the network is operating within set parameters, as 
measured by the transit delays and jitter, the network 

15 can be considered healthy. If the transit delays or the 

jitter measurements do not meet a predetermined 
threshold, an alarm can be indicated to thereby alert 
the network operators that problems in the network 
performance need to be addressed. 

20 The above methods can be run as a software 

module within a main software process residing on a 
Network Management Computer (NMC) that executes the 
methods described in US Patents 5,933,416 and 5,926,462. 
This main process receives information about the devices 

25 in the network from a second software process, which 

periodically gathers information directly from the 
devices or nodes in the network. The main process uses 
this information to construct the physical topology of 
the network. A software module is then used to 

30 periodically send signals to the devices in the network 

and to accurately record the associated round trip 
delays. The signal used here is the *ping' operation. 
The processing time for this operation is negligible (or 
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constant) with respect to the transmission times over 
the network between the NMC and the node. This 
information is passed on to the main process which uses 
it in conjunction with the physical topology of the 
5 network to compute delays on a device as described 

above. For every node A being monitored, the main 
process would compute delays D(A, B) and D(C, A) where B 
and C are nodes that are directly connected to A, i.e., 
if a graph is used to represent nodes and edges 

10 represent direct physical connections between devices, B 

and C would be adjacent nodes to A with edges between B 
and A and C and A. 

D (A, B) and D(C,A) are computed for every 
device A being monitored by the main software process. 

15 These calculations are stored in an internal device 

database as will as a statistical database. The 
internal device database stores the most recent D (A, B) 
values for a device whereas the statistical database 
stores the history of D (A, B) values over a period of 

20 time. Average D (A, B) values for 5-minute and 1-hour 

intervals over the previous two days and 1-day intervals 
for older samples are stored in the statistical 
database . 

Instantaneous jitter values J (A, B) (between 
25 two consecutive delay samples) are also computed, along 

with simple statistical measures over them such as the 
minimum, maximum and average, and stored in the two 
databases as described above for D (A, B) . Long term 
jitter is not stored explicitly in the database but 
30 rather computed on demand from the D (A, B) values stored 

in the statistical database. These values of J (A, B) and 
D (A, B) are read in by a third software process which 
produces reports. These values can be used to generate 
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alarms based on comparisons with user specified alarm 
thresholds. These values can be graphically displayed 
such as, for a certain threshold, all points in the 
network where the jitter and delay exceed the threshold 
5 are highlighted in a certain colour on a graphical map 

displaying the topology of the network. The user can 
change thresholds and at a glance, see the non- 
conforming portions of his network. 

The user may also specify two devices A and B 

10 (not necessarily connected directly to each other) over 

which the user would like to see delays D (A, B) and 
jitters J (A, B) computed and alarmed. This is very 
useful in identifying the total delay and jitter 
experienced by a user on device A who is sending signals 

15 to device B. Since applications usually specify minimum 

requirements for acceptable service in terms of the end 
nodes involved in the application, the above calculation 
becomes essential . 

A person understanding the above-described 

20 invention may now conceive of alternative designs, using 

the principles described herein. All such designs which 
fall within the scope of the claims appended hereto are 
considered to be part of the present invention. 
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